firstPRO is seeking a Senior Data Engineering Lead to oversee the development and optimization of our client’s data pipelines, architectures, and governance frameworks. The ideal candidate will bring extensive experience in data engineering, modeling, and cloud-based solutions, along with a proven track record of leading cross-functional teams and mentoring technical talent.
This role is a direct hire opportunity for our client located in the Pottstown, PA Area. This role has a hybrid work model which requires 2-3 days onsite.
Responsibilities
- Design, develop, and maintain robust data pipelines to process structured and unstructured data across cloud and on-premises environments.
- Partner with architects, product owners, and software engineers to gather requirements and define strategies for seamless project delivery.
- Collaborate with BI teams to optimize data utilization for actionable business insights and data-driven decision-making.
- Ensure adherence to governance frameworks and compliance with security protocols while promoting best practices across the team.
- Mentor data engineers, lead project reviews, and manage deliverables for onshore and offshore teams.
Requirements
- 10+ years in technology roles with 8+ years in data engineering, modeling, and warehousing.
- Demonstrated expertise in the full data lifecycle, from ingestion to warehousing.
- Solid experience leading Agile projects and managing cross-functional teams.
- Proficient in Python, PySpark, Talend, SAP BODS, Kafka, and Kubernetes.
- Extensive experience with AWS (S3, Glue, Athena, EMR, Redshift), Snowflake, and Databricks.
- Strong knowledge of data formats (Avro, Parquet), SQL and NoSQL databases, and Data Lake/Lake House architectures.
- Familiarity with analytics tools like Qlik Sense, Sagemaker, Dataiku, and SAS Viya.
